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performs magnification of the individual reduced images, thereby generatmg 
the out-of-focus images. Rirthermore, the deptb^f-field display method 
controls the levels of die out-of-focus states accoixling to levels of the 
sequential reductions. 
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DESCRIFTON 



IMAGE RENDERING HETHOO AND APPARATUS 



5 



BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a rendering apparatus and a rendering method 
for showing depth of field and a storage medium for storing a data-processing program 
10 for the rendering method. 

Description of the Related Art 

Conventionally, to allow three-dimensional objects to be rendered, entertainment 
systems, such as TV game apparatuses perform perspective transformations so that the 
objects can be displayed on two-dimensional screens. In this case, processing such as 
15 light-source computation is also performed so as to display the objects three- 
dimensionally. 

To date, however, there has been no method for showing depth of field giving a 
sense of distance in the direction from the viewpoint to the object (Z direction). 

20 SUMMARY OF THE INVENTION 

In view of the problems described above, the present invention provides a 
rendering apparatus capable of showing depth of field. Furthermore, the invention 
provides a depth-of-field display method for displaying a sense of distance from a 
viewpoint to objects on a two-dimensional screen. Still Furthermore, the present 
25 invention provides a data-processing program for displaying the sense of distance from 
the viewpoint to the objects on the two-dimensional screen. 

A rendering apparatus of the present invention comprises a device for generating 
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an image in an out-of-focus state by using an original image in a just-in-focus state, 
reducing the original image, and thereafter, magnifying the reduced image. 

Also, the rendering apparatus of the invention comprises a Z-buffer for setting 
the depth direction of pixels and a pixel-interpolation algorithm and further comprises a 
5 device for presetting a Z value of the abovementioned Z-buffer, a device for generating 
an image in a out-of-focus state by reducing an original image in a just-in-focus state, 
and thereafter, magnifying the reduced image; and a device for overwriring the 
abovementioned image in the out-of-focus state on the abovementioned original image 
by using the abovementioned preset Z value. In the above, the described rendering 
10 apparatus turns an image field of an object corresponding to the point represented by the 
abovementioned Z value to the just-in-focus state, and concurrently, turns an image field 
of an object other than the abovementioned object to the out-of-focus state, thereby 
showing depth of field. 

The above-described rendering apparatus of the present invention which uses the 
15 abovementioned device for generating the image in the out-of-focus state by reducing 
the abovementioned original image and then magnifying the reduced image sequentially 
reduces the abovementioned original image and, thereafter, magnifies the reduced 
images, thereby generating the images in out-of-focus states. In this case, it is 
preferable that the abovementioned pixel-interpolation algorithm is a bilinear filter 
20 method. 

Also, the rendering apparatus of the present invention further comprises alpha 
planes for selectively masking the pixels, hi this, the rendering apparatus uses the 
abovementioned preset Z value to sequentially reduce the abovementioned original 
image, to overwrite out-of-focus and blurred images obtained by magnifying the 
25 reduced images on tfie abovementioned original image, and to turn image fields of 
objects located farther than a point represented by the abovementioned Z value. The 
described rendering apparams also uses the abovementioned alpha planes to mask the 
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image fields of the objects located farther than the point represented by the 
abovementioned Z value, thereafter, to overwrite the abovementioned out-of-focus and 
blurred images on the abovementioned original image, and to turn image fields located 
nearer than the point represented by the abovementioned Z value to out-of-focus states. 

It is preferable that the above rendering apparatus further comprises a video 
RAM (VRAM) having a rendering area and a texture area in the same memory space to 
sequentiaUy reduce the abovementioned origmal image in the abovementioned VRAM 
and, thereafter, to magnify the reduced images, thereby generating the abovementioned 
out-of-focus and blurred images. 

Also, the rendering apparatus comprises a Z-bu£fer for setting the depth direction 
of pixels and a pixel-intenx>lation algorithm and further comprises a device for 
presetting a Z value of the abovementioned Z-buffer; 

a device for generating multiple out-of-focus images each having a unique out- 
of-focus level by reducing an original image in a just-in-focus state to images each 
15 having a unique linear ratio, and thereafter, magnifying images thereby reduced; and 

a device for using the abovementioned preset Z value to overwrite the 
abovementioned out-of-focus image on the image in the just-in-focus state, of which the 
abovementioned out-of-focus level is increased corresponding to an increase in its 
distance from a point represented by the abovementioned Z value, on the original image. 
20 In this, the abovementioned rendering apparatus turns an image field of an object 
located at a point corresponding to the abovementioned Z value to the just-in-focus state, 
and concurrentty, turns an image field of an object other than the abovementioned object 
to the out-of-focus state wherein the abovementioned out-of-focus level is increased 
corresponding to an increase in its positional distance from the point represented by the 
25 abovementioned Z value, thereby generating images showing depth of field. 

Furthermore, an image-generating method of the present invention comprises 
steps for preparing an original image in a just-in-focus state, reducing the 
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abovementioned original image, and magnifying the reduced image, thereby generating 
an image in an out-of-focus state. 

Also, the image-generating method of the invention comprises steps for 
preparing an original image in a just-in-focus state, sequentially reducing the 
5 abovementioned original image, and magnifying the reduced images, thereby generating 
images in out-of-focus states. 

Also, the image-generating method of the invention comprises sreps for 
preparing an original image in a just-in-focus state, sequentially reducing the 
abovementioned original image to images each having a unique linear ratio, and 
10 individually magnifying the reduced images each having the unique linear ratio, thereby 
generating a plurality of out-of-focus images each having a unique blurred level. 

Also, the depfli-of-field display metiiod of the invention comprises steps for 
using a pixel-interpolation algorithm to reduce an original image, and thereafter, to 
magnify the reduced image, thereby generating a bluired and out-of-focus image; and 
15 for using a Z-buffer capable of controlling die distance in the depth direction from a 
viewpoint, tiiereby overwriting the abovementioned out-of-focus image on the 
abovementioned original image. 

Also, the depth-of-f,eld display method of the invention comprises steps for 
using a pixel-interpolation algoritiim to sequentially reduce an original image, and 
20 thereafter, to magnify the reduced images, tiiereby generating out-of-focus images; and 
for using alpha planes having a masking function to mask image fields of objects 
located farther tiian a point represented by a preset Z value and to overwrite the 
abovementioned out-of-focus images on the abovementioned original image that has 
been masked, thereby turning image fields that have not been masked to out-of-focus 
25 states. 

Also, tiie depth-of-field display metiiod of the present invention comprises steps 
for using a pixel-interpolation algorithm to sequentially reduce an original image, and 
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thereafter, to magnify the reduced images, thereby generating images in out-of-focus 
states; for using a Z-buffer capable of controlling the distance in the depth direction 
from a viewpoint to overwrite the abovementioned images in the out-of-focus states on 
the abovementioned original image, thereby turning image fields of objects farther than 
5 the poim represented by a preset Z value to out-of-focus states; and for using alpha 
planes having a masking function to mask the image fields of the objects located farther 
than the point represented by the abovementioned preset Z value and to overwrite the 
abovementioned images in the out-of-focus states on the abovementioned original 
image, thereby turning image fields that have not been masked to out-of-focus states. 
10 In addition, the depth-of-field display method comprises steps for turning image 

of objects located at a position corresponding to a preset Z value to a just-in-focus state 
and overwriting images of which levels of out-of-focus states are sequentially increased 
corresponding to an increase in their positional distances to one of a farther direction 
and a nearer direction from a point represented by the abovementioned preset Z value; 
15 for using a pixel-interpolation algorithm to perform sequential reductions of an original 
image, and thereafter, to perform magnification of the reducxd images, thereby 
generating the abovementioned images in the out-of-focus states; and for controlling 
levels of the abovementioned out-of-focus states according levels of the 
abovementioned sequential reductions. 
20 Still furthermore, a storage medium of the present invention stores an image- 

generating program so as to be readable and executable by a computer. In this, the 
image-generating program comprises steps for preparing an original image in a just-in- 
focus state, reducing the abovementioned original image, and magnifying the reduced 
images, thereby generating images in out-of-focus states. 
25 Also, the storage medium of the present invention which stores the image- 

generating program so as to be readable and executable by a computer, wherein the 
image-generating program comprises steps for preparing an original image in a just-in- 
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focus State, sequentially reducing the abovementioned original image to images each 
having a unique linear ratio, and individually magnifying the reduced images each 
having a unique linear ratio, thereby generating a plurality of out-of-focus images each 
having a unique blurred level. 

Also, the storage medium of the present invention, which stores the image- 
generating program so as to be readable and executable by a computer, wherein the 
image-generating program comprises steps for using a pixel-interpolation algorithm to 
sequentially reduce an original image, and thereafter, to magnify the reduced images, 
thereby generating images in out-of-focus states; for using a Z-buffcr capable of 
controlling the distance in the depth direction from a viewpoint to overwrite the 
abovementioned out-of-focus images on the abovementioned original image, thereby 
turning image fields of objects farther than a point represented by a preset Z . value to 
out-of-focus states; and for using alpha planes having a masking function to mask the 
image fields of the objects located farther than the point represented by the 
abovementioned preset Z value and to overwrite the abovementioned images in the out- 
of-focus states on the abovementioned original image, thereby turning image fields that 
have not been masked to out-of-focus states. 

Also, the storage medium of the invention, which stores the image-generating 
program so as to be readable and executable by a computer, wherein the image- 
generating program comprises steps for using a pixel-interpolation algorithm to reduce 
an original image, and thereafter, to magnify the reduced image, thereby generating a 
blurred and out-of-focus image; and for using a Z-buffer capable of controlling the 
distance in the depth direction from a viewpoint, thereby overwriting the 
abovementioned out-of-focus image on the abovementioned original image. 

Also, the storage medium of the invention which stores the image-generating 
program so as to be readable and executable by a computer, wherein the 
abovementioned image-generating program comprises steps for using a pixel- 
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interpolation algorithm to sequentially reduce an original image, and thereafter, to 
magnify the reduced images, thereby generating out-of-focus images; and for using 
alpha planes having a masking function to mask image fields of objects located farther 
than a point represented by a preset Z value and to overwrite the abovementioned out- 
5 of-focus images on the abovementioned original image that has been masked, thereby 
turning image fields that have not been masked to out-of-focus states. 

Also, the storage medium of the present invention, which stores the image- 
generating program so as to be readable and executable by a computer, wherein the 
image-generating program comprises steps for using a pixel-inteipolation algorithm to 
0 sequentially reduce an original image, and thereafter, to magnify the reduced images, 
thereby generating out-of-focus images; for using a Z-buffer capable of controlling the 
distance in the depth direction fix)m a viewpoint to overwrite the abovementioned out- 
of-focus images on the abovementioned original image, thereby turning image fields of 
objects farther than a point represented by a preset Z value to out-of-focus states; and 
; for using alpha planes having a masking function to mask image fields of objects 
located farther than the point represented by the abovementioned preset Z value and to 
overwrite the abovementioned out-of-focus images on the abovementioned original 
unage, thereby turning image fields that have not been masked to out-of-focus states. 

Also, the storage medium of the present invention, which stores the image- 
generating program so as to be readable and executable by a computer, \<*erein the 
abovementioned image-generating program comprises steps for turning image of 
objects located at a position corresponding to a preset Z value to a just-in-focus state 
and overwriting images of which levels of out-of-focus states are sequentially increased 
corresponding to an increase in their positional distances to one of a farther direction 
and a nearer direction from a point represented by the abovementioned preset Z value; 
for using a pixel-interpolation algorithm to perform sequential reductions of an original 
image, and thereafter, to perform magnification of the reduced images, thereby 
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generating the abovementioned images in the out-of-focus states; and for controlling 
levels of the abovementioned out-of-focus states according levels of the 
abovementioned sequential reductions. 

In addition, in the above, the abovementioned preset Z value may be serially 
varied per image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIGS. lA to IC are views used to explain alpha bits; 
FIGS. 2A and 2B are views used to explain a point-sampling method; 
FIGS. 3A to 3B are views used to explain a bilinear filter method; 
FIGS. 4A and 4B are views used to explain mdividual cases where bilinear filters 
are used to sequentially reduce images and, thereafter, to magnify the reduced images; 

FIG. 5 shows views used to explain a case where the bilinear filters are used to 
sequentially reduce images and, thereafter, to magnify the reduced images; 

FIG. 6 is a view used to explain a case where a Z value is used to overwrite a 
smoothed and blurred image on an original image; 

FIG. 7 shows an original image stored in a VRAM rendering area; 
FIG. 8 shows a case where an original image is sequentially reduced; 
FIG. 9 shows a case where an original image is sequentially reduced to 1/16 and, 
thereafter, is magnified; 

FIG. 10 shows a case where a Z-buffer is used to the original image in FIG. 9 is 
sequentially reduced to 1/16, and thereafter, die reduced image is magnified and is 
overwritten on the original image in FIG. 7; 

FIG. 11 shows a case where a near Z value (Znear) is specified to paint out mask 
planes in the VRAM rendering area (The area painted in red for the explanation (area 
other than the object located near) in this figure is not visible on an actual screen); 

FIG. 12 shows a case where the image in FIG. 9 is overwritten on a masked 
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image; 

FIG. 13 is a view used to explain a depth-of-field display metliod; 
FIG. 14 is a flowchart used to explain steps of the depth-of-field display method 
in cooperation with flowcharts of FIGS. 15 and 16; 
5 FIG. 15 is a flowchart used to explain steps of the depth-of-field display method 

in cooperation with flowcharts of FIGS. 14 and 16; and 

FIGS. 16 is a flowchart used to explain steps of the depth-of-field display 
method in cooperation with flowcharts of FIGS. 14 and 15. 

3 DESCRIPTION OF THE PREFERRED EMBODIMENT 

[Hardware Configuration] 

In image generation processing, a depth-of-field display method of the present 
invention is implemented with an image-processing system, such as an entertainment 
system, for example, a game apparatus, that satisfies tiie following conditions: 

(i) The system shall have a Z-buffer that can control a Z direction (depth 
direction) of individual pixels; 

(ii) The system shall be capable of alpha-mask processing (having an alpha 
filter); and in addition, 

(iii) The system shall have a bilinear filter. 

However, as described below, in an entertainment system, when an image on 
which predetermined processing has been provided (which is referred to as a processed 
image, hereinbelow) is overwritten, if the system has no hardware restrictions such as 
the a Z-buffer permits selective overwriting only when its capacitance is smaller than 
(or larger than) a preset Z value, and the Z-buffer permits optional and selective 
overwriting when its capacitance is smaUer than or larger than the preset Z value, the 
condition (ii), namely that the system shall be capable of alpha-mask processing, may 
be unnecessary. 
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(Z-Buffer) 

Hardware employed in this embodiment is preferably a video RAM (VRAM) 
with a Z-buffer. In particular, as shown in FIG. lA, individual dots (pixels) are 
specified in the VRAM. For example, in addition to R (red), G (green), and B (blue) 
color elements of 8-bit values, the VRAM has areas for storing a Z value of up to 32 
bits and an A value ("alpha bits", or "alpha planes") of up to 8 bits. 

The Z value is a parameter that represents distance from the viewpoint up to an 
object. In perspective transformation in a graphic processing unit (GPU), when a 
perspective transformation is carried out for a three-dimensional object to an objea on a 
two-dimensional screen, the distance (depth information) from the viewpoint is also 
computed, and the Z value is determined according to the depth information. At this 
time, the R, G, and B values are also determined by light-source computation. 

For example, as shown in FIGS. IB and IC, when an object 100 is arranged 
relatively nearer to the viewpoint, the Z value of dots that compose the object 100 is set 
to be large. In contrast, when tiie object 100 is arranged relatively farther from Uie 
viewpoint, the Z value of dots that compose the object 100 is set to be small. At this 
time, by making use of the Z value, the depth from the viewpoint of the object (value of 
the viewpoint coordinate system in the z-axis direction) can be determined. 

Accordingly, in the generation of an image composed of multiple objects in one 
screen, when a Z value (for example, a mean Z value between a Z value of the object 
100 and a Z value of an object 102) is preset, and a processed image (an image created 
by performing processing on the original image) is overwritten on the original, a portion 
of an image corresponding to the object 100 whose Z value is determined to be 
relatively large (that is, relatively nearer from the viewpoint) as a result of comparison 
to the preset Z value remains unchanged (that is, the portion is not transformed in the 
units of pixels). On the other hand, a portion of an image corresponding to the object 
102 whose Z value is determined to be relatively small (that is, relatively farther from 
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the viewpoint) can be generated as an image overwritten on a processed image (that is, 
the portion is transformed in units of pixels). 

In this way, the Z-buffer can be used in the generation of an image composed of 
multiple objects in the depth direction. 
(Alpha Planes) 

The alpha value A shown in FIG. lA is a parameter for controlling a combination 
of pixel colors and also for performing masking processing for the entire image or a part 
of an image. The masking processing refers to, for example, processing that performs 
selective execution by which a masked image area is not colored in coloration of an 
image. 

In this way. in overwriting a processed image on the original image, according to 
the provision of the alpha value A in the original image, dots are thereby masked (dots 
for which mask bits are mmed on) and are not overwritten with the processed image. 
[First Stage Depth-of-field Display] 
(Point-Sampling Method) 

Generally, conventional TV game apparatuses employ a point-sampling method 
for magnifying or reducing images. 

The point-sampling method is briefly described below with reference to FIGS. 
2A and 2B. FIG. 2A shows the original image (that is, a prereduction image). FIG. 2B 
shows an image after reduction by a linear ratio of 1/2 (area ratio of 1/4). To make the 
explanation to be concise, the image in FIG. 2A is assumed to be composed of 4 x 4 
dots, tiiat is 16 pixels, and the image in FIG. 2B is composed of 2 x 2 dots, that is four 
pixels. Also, in order to specify the position of the pixels, the horizontal direction of 
each image is set to be an x-axis direction, and the vertical direction thereof is set to be 
a y-axis direction, wherein the position of the right upper dot of each image is 
represented as (x, y) = (1, 1). In FIG. 2A, each of the 16 dots is signified by R, G, and 
B values; however, to make the explanation to be concise, only the four dots shown 
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therein are represented by synabols O, @, x, and A. 

In the point-sampling method, to generate a post-ieduction dot at (x, y) = (i, i), 
the position of the post-reduction dot at (x, y) = (1, i) is first computed, then, a dot 
whose position is nearest thereto is retrieved from the four dots in corresponding pre- 
5 reduction areas at (x, y) = (1, 1). (i. 2), (2, 1). and (2, 1). In this case, if the position 
nearest to the post-reduction dot at (x, y) = (1, 1) is assumed to be the dot in the pre- 
reduction area of (x, y) = (1, 1), the dot represented by O represents the contents of the 
post-reduction dot at (x, y) = (1, l). Similarly, to generate a post-reduction dot at (x, y) 
= (2, 1), the position thereof is first computed, then, a dot whose position is nearest 
10 thereto is retrieved from the four dots in corresponding pre-reduction areas at (x, y) = (3, 
1). (4, 1), (3, 2), and (4, 2). In this case, if the position nearest to the post-reduction dot 
represented by (x. y) = (2, 1) is assumed to be the dot in the pre-reduction area at (x, y) 
= (3, 1), the dot represented by the symbol @ represents the contents of the post- 
reduction dot at (x, y) = (2, 1). 

15 Similarly to the above, dots represented by the symbols x and A represent post- 

reduction dots at (X, y) = (1, 2) and (x, y) = (2, 2). respectively. That is. the point- 
sampling method eliminates unnecessary dots (pixels) from a pre-reduction image to 
generate a post-reduction image. Therefore, among dots composing the pre-reduction 
image, those not used for the post-reduction image are discarded. 

20 According to the above, even though an image reduced by the point-sampling 

method is magnified, since the pre-reduction image information is partly discarded, an 
image including noise is simply magnified, thereby producing an mosaic image. 
(Bilinear Filter Method) 

Next, a description will be given of a bilinear filter method that performs 
25 reducing/magnifying processing in a different manner from the point-sampling method. 
HGS. 3A to 3C are used for explaining the bilinear filter method. FIG. 3A shows the 
original image (pre-reduction image) composed of 4 x 4 dots. FIG. 3B shows a first- 
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stage post-reduction image composed of 2 x 2 dots. FIG. 3C shows a second-stage 
post-reduction image composed of one dot. Also, the 16 dots representing the image in 
FIG. 3A are signified with R, G. and B values; however, to malce the explanation to be 
concise, an average value of the four-upper left dots is represented by the symbol •. an 
5 average value of the four-lower left dots is represented by the symbol A. an average 
value of the four-upper right dots is represented by the symbol □, and an average value 
of the four-lower right dots is represented by the symbol ■. 

To generate a dot of the first-stage post-reduction image at (x, y) = (i, i), the 
bilinear filter method uses the average value (•) of ti,e four dots in the corresponding 
10 pre-reduction areas in FIG. 3A. that is. at (x. y) = (l, i). (2, i), (i, 2). and (2, 2). 
Similarly, to generate a post-reduction dot at (x, y) = (2, 1), the method uses the average 
value (□) of the four dots in the corresponding pre-reduction areas in FIG. 3A, that is, 
at (X. y) = (3, 1), (4, 1), (3, 2), and (4, 2). 

Similarly, the bilinear filter method uses the average value (A) of the four dots 

15 in the pre-reduction areas fx, y) = fl 3\ n -w n a\ /n a\ * 

^ yj 11, j;, (z, j;, (1, 4), and (2, 4) to generate a post- 
reduction dot (X. y) = (1, 2). Also, the method uses the average value (■) of the four 
dots in the pre-reduction areas (x, y) = (3, 3), (4, 3), (3, 4). and (4, 4) to generate a post- 
reduction dot (X, y) = (2, 2). Here, to make the explanation to be concise, an average 
value of the above four average values (•, □, A, and ■) is assumed to be represented 
20 by symbol @. 

In addition, to perform a second-stage reduction (linear ratio of 1/4), the bilinear 
filter method uses the average value @ of the four dots shown in FIG. 3B. 

According to the point-sampling method described first, the number of dots 
corresponding to the difference between the number of dots composing the pre- 
25 reduction image and the number of dots composing the post-reduction image is 
discarded in reducing processing. That is, a post-reduction image is generated, in which 
tens of percent of the pre-reduction image information is not used. However, the 
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bilinear filter method is different from the point-sampling method in that it makes use of 
all dots (information) composing the pre-red«ction image, thereby generating the post- 
reduction image. 

Nevertheless, the bilinear filter method is still furnished with predetennined 
5 restrictions in the algorithm. For example, when the scale is smaller than a linear ratio 
of 1/2, the algorithm of the method uses an average value of four dots composing a pre- 
reduction image, which corresponds to one dot composing a post-reduction image. 
Accordingly, to reduce a pre-reduction image to, for example, an image at a linear ratio 
of 1/16, a single reduction processing looses tens of percent of pre-reduction image 
10 information. As a result, when the image reduced at a ratio of 1/16 is magnified bad. to 
an image of the original size, the magnified image includes noise. 

However, by reducing the pre-reduction image step-by-step at linear ratios of 1/2, 
1/4. 1/8. 1/16, and so forth in relation to the original image, it can be theoretically said 
that an image in which the complete infomiation of the pre-reduction image is reduced 
15 to an intended resolution is produced. 

Therefore, for example, as shown in FIG. 4A, to magnify an image reduced at a 
ratio of 1/4 to the original image (this magnifying processing is performed once), dots 
are combined depending on the distance, and interpolation is performed. In the case of 
a real image, an image is never composed of a single dot. For example, in magnifying 
an image of 2 x 2 dots shown in FIG. 3B to an image of 4 x 4 dots shown in FIG. 3A, 
positions at four points corresponding to a post-magnification image shown in FIG. 3A 
are individually set to be □, A, and ■, according to dots □, A, and . in pre- 
magnification positions A, and ■ shown in FIG. 3A, individual dots around 

these four points are generated according to interpolation performed depending on the 
25 distance from the individual points by use of the set values. 

Compared to images reduced or magnified according to the point-sampling 
method presentiy used, the method using the bilinear filter can reproduce images that 
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are blurred (i.e., images that are out of focus) and are smoothed according to 
interpolating processing. A description will be given of the above with reference to FIG. 
5 and an example of a combined VRAM that has a rendering area 501, a plurality of 
work areas 0 to n (reference symbols 502 to 505), and the like in the same memory 
space. First, an image in the VRAM rendering area 501 (original image) is reduced 
sequentially in multiple steps at linear ratios of 1/2, 1/4, 1/8, and so forth by use of the 

work areas 502 to 505, thereby creating an image having an final resolution of (1/2)*^+! 
of the original image. 

According to the step-by-step reductions at a ratio of 1/2, when a pixel- 
interpolation algorithm, such as the bilinear filter method, is applied to an image- 
reducing algorithm, a reduced image for which all the information in the original image 
has been sampled can be generated. 

In a sense, the above phenomenon is similar to a case where, for example, an 
image (original image) displayed in 600 dpi (dots per inch) is scanned at 400 dpi (in this 
case, however, the image is not physically reduced), is next scanned at 200 dpi (in this 
case as well, the image is not physically reduced), and thereafter, the 200-dpi image is 
reproduced as an image of 600 dpi. For example, although the 200-dpi image contains 
the complete information of the original image, the reproduced 600-dpi image is 
smoother than the original image. A characteristic similar to the above case is that the 
image is blurred according to the fact that the resolution is once reduced. 

The linear ratio of 1/2 is simply an example, and there are no restrictions thereto. 
That is, the restriction to the effect-when the scale is smaller than the linear ratio of 1/2, 
an average value of four pre-reduction dots corresponding to one post-reduction is 
assumed-is simply a restriction in the algorithm employed in this embodiment. For 
example, suppose an algorithm such as that when an image is reduced at a linear ratio of 
1/4, an average value of 16 pre-reduction dots is used, and the complete dot information 
on a pre-reduction image is used in reduction. In this case, restrictions below the linear 
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ratio of 1/2 in the reduction are unnecessary. 

The inventor and concerned members have discovered that an image showing 
depth of field can be generated by reducing an image step-by-step, magnifying and 
reproducing die image and by maicing use of the reproduced image that is smoothed and 
5 blurred. 

It is known that when an reproduced image created by reducing the original 
image (pre-reduction image) step-by-step, then magnifying the reduced image is 
overwritten on the entire part of one screen, the entire screen is displayed in an out-of- 
focus (blurred) state. 

10 (1) Hereinbelow, discussion will be given of a case where the Z-buffer is used to 

generate an image that contains a plurality of objects each having a unique Z value (that 
is, the distance to object from the viewpoint is unique), wherein an object relatively 
farther is displayed in a blurred state (out-of-focus or defocus state), and an objea 
relatively nearer is displayed in a just-in-focus state. 

^ shown in FIG. 6, a case is assumed such that a screen contains at least an 
object 102 located relatively farther and an object 100 located relatively nearer. In this 
case, a relationship occurs such that dots composing the object 100 located relatively 
nearer have a large Z value on average, whereas dots composing the object 102 located 
relatively farther have a small Z value on average. 

20 Here, an image (image-1) in the just-in-focus state, containing multiple objects, 

is prepared (refer to FIG. 7). Here, the Chinese characters '')i","Ef ^" and "jfi" of each 
object mean Far, Intermediate and Near, respectively. Then, this image is reduced step- 
by-step, as described with reference to FIG. 5 (refer to FIG. 8). Subsequently, the image 
is magnified, thereby generating a smoothed and blurred image (image-2) (refer to FIG. 

25 9). 

The above-described Z-buffer compares the large-and-small relationship of Z 
values of individual dots. By use of these Z values, a Z value that is near the Z value of 
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the object 100 located relatively nearer is preset. According to the preset value, the 
blurred image (image-2) is then overwritten on the image (image-]) that is in the just- 
in-focus state. According to a Z-bu£fer in an entertainment system currently being 
developed, processing in a single direction is implemented such as that an image field of 
an object located farther than a point represented by the preset Z value (small Z value) 
is overwritten. On the other hand, an image field of an object located relatively nearer 
(point represented by a large Z value) remains not overwritten. 

As a result of the above single-direction processing, multiple objects can be 
generated so as to be displayed on a screen in which an object located relatively farther 
is in the blurred state. However, an object located relatively nearer is in the just-in- 
foais state (refer to FIG. 10). 

The final resolution image is outputted to the original VRAM rendering area 501 
by use of a pixel-interpolation algorithm (for example, the bilinear filter method). 

At this time, by setting an appropriate value to the Z value, only pixels located 
farther than a point represented by the Z value are overwritten as an image at a reduced 
resolution. This allows production of images that are in the bluncd state when they are 
located farther than the border of the Z value. 

(2) Next, discussion will be made for images in a case opposite to the case 
discussed in (1) above. 

Hereinbelow, discussion will be made for a case where the Z-buffer is used to 
generate an image that contains a plurality of objects each having a unique Z value (that 
is, the distance to the object from the viewpoint is unique), wherein an object relatively 
farther is displayed in the just-in-focus state, and an object relatively nearer is displayed 
in the blurred state. 

Originally, in a processing system that allows inversely setting of the Z value (a 
processing system that does not allow overwrite of pixels located relatively farther), an 
image field located nearer tfian a point represented by a preset Z value can be 
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overwritten so as to be an image having a reduced resolution. As a result, the nearer 

portion of the image is displayed in the blurred state. 

As described above, however, with the Z-buffer currently being developed by the 

inventor and concerned members, according to determination made by comparison of Z 
values, an image located relatively nearer (when the Z value is large) can be remained 
not overwritten, and an image located relatively farther (when the Z value is small) can 
be overwritten. Nevertheless, the Z-buffer serves with restrictions in the opposite case. 
According to this Z-buffer, the object located relatively nearer (when the Z value is 
large) can be overwritten, whereas the object located relatively farther is remained not 
overwritten. 

In the described processing system that does not allow inverse setting of Z values, 
masking processing can be implemented by use of the alpha bit (refer to FIG. 1 A), and 
control can be implemented whether or not overwriting is performed. This allows the 
short side to be overwritten in the following manners: 

1) Paint out only alpha-mask planes composed of pixels represented by 
rendering-VRAM Z values, which are located farther than a point represented by a 
preset Z value. That is, the planes are masked. 

2) Set an alpha-plane testing condition so that only pixels that are not covered 
with masks are overwritten. 

3) Overwrite an image of which resolution is reduced. 

As a result of the above, pixels not covered with masks of the alpha planes, that 
is, only the pixels whose distances are nearer than the point represented by the preset Z 
value, are overwritten as an image whose resolution is reduced. This is described below 
in more detail. 

First, masking processing is carried out. At the step of the masking processing, 
the alpha value A is used to cover masks over one image, and the image covered with 
the masks is overwritten to the original image only for an image field located farther 
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than a point represented by a Z value (a field where the Z value is large). In this case, R. 
G, and B values are not related and only alpha values A are rendered (which is also 
expressed as mask bits are turned on.). However, even though the mask bits are turned 
on, no difference in the images is recognizable to the human eyes. In this step, only an 
image field of an object located relatively farther is overwritten, whereas an image field 
of an object located relatively nearer is remained not overwritten (Refer to FIG. 11. 
Note that areas covered with mask planes are shown in red so as to be quickly 
identified.). 

Subsequentiy, a blurred image is overwritten onto the image field of the object 
located relatively nearer. First of all, smoothed and blurred images obtained by step-by- 
step reductions and magnification performed after the reductions are prepared. Here, in 
the original image, only an image field of an object located relatively farther is covered 
with the masks, and an image field of an object located relatively nearer is not covered 
with the masks. On the other hand, the image field of the object located relatively 
nearer is overwritten as a smoothed and blurred image. 

The procedure described above allows generation of a screen on which multiple 
objects each having a unique Z value are displayed, an object located relatively farther 
is displayed in the just-in-focus state, and an object located relatively nearer is displayed 
in the blurred state (refer to FIG. 12). 
(Blurring Profiles) 

At the above step, however, overwriting is carried out onto the original image in 
which only the image field of the object located farther than a point represented by a Z 
value as the blurred image is overwritten. In this case, a border or a profile of the object 
located relatively nearer is determined with the Z value in a single definition. For this 
reason, the profile of an object located relatively nearer is clear, and an unage of a 
smoothed and blurred object is placed within the profile as is fitted therein. 

However, as a concept to perform realistic display of the object located relatively 




wo 00/52640 PCT/JPOO/01 048 

-20- 

nearer in the blurred image, it is more natural to display the object with a blurred profile 
so as to look expanded. According to this concept, further blurring processing for the 
distance is performed so as to blur the profile. 

At this step, the original image of an object is reduced step-by-step, and then, 
5 the reduced image is magnified, thereby allowing a blurred image of the object to be 
obtained. Here, an object located relatively nearer is conceptually separated into an 
interior portion and a profile portion. The interior portion is located relatively nearer 
(the Z value is large), therefore, it is not overwritten. On the other hand, however, since 
the profile portion slightly expanded because it has been reduced and magnified is not 
10 originally given a Z value of the object located relatively nearer, the profile portion is 
overwritten. 

By using the blurred profile portion thus obtained and the described blurred 
interior portion, both the profile portion and interior portion of the object located 
relatively nearer are displayed as a smoothed and blurred image. 

15 According to the described bilinear filter method using the Z value and the alpha 

value A, with a preset Z value (depth), an image field of an object located farther than a 
point represented by the preset Z value can be bluned, and thereafter, an image field of 
an object located nearer than that point can be blurred. 
[Multistep Depth-of-field Display] 

20 By performing the above-described processing in multisteps, pseudo depth-of- 

field display with an optical lens can be implemented. 

The multistep depth-of-field display is described below in detail. By reducing 
image step-by-step as described with reference to FIG. 3 and then magnifying the 
reduced images as described with reference to FIG. 4, the image can be smoothed and 

25 blurred (refer to FIGS. 8 and 9). At this time, as shown in FIG. 5, the blurred level 
differs depending upon the reduction level. Suppose there are two images here. One is 
an image A (having a resolution of 1/16) produced in a manner that an image is reduced 
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step-by-step at ratios of 1/2, 1/4, 1/8, and 1/16, and thereafter, the reduced images are 
magnified. The other is an image B (having a resolution of 1/4) produced in a manner 
that an image is reduced step-by-step at ratios of 1/2 and 1/4, and thereafter, the reduced 
images are magnified. When these two images A and B are compared, it is known that 
the blur level of the image A is higher than the blurred level of the image B. 

By performing reduction and magnification to produce multiple images each 
having a unique blurred level and by using these images, images showing multistep 
depth of field can be obtained as described below. 

In a single image representing multiple images each having a unique Z value, for 
example, an object having an intermediate Z value (representing an intermediate depth) 
is arranged in a just-in-focus state. As arrangement in the direction of depth (depth 
direction), the blurred level of an object having a Z value smaller than the above 
(representing a point farther than the above) is sequentially increased according to the 
level of the depth direction. In contrast, the blurred level of an object having a Z value 
larger than the above (representing a point nearer than the above) is sequentially 
increased according to the level of the nearer direction. 

In this way, when an object having an preset intermediate Z value is displayed in 
the just-in-focus state, and when the object is arranged to space far away from and 
nearer to a point represented by the Z value in the depth direction, an image whose 
blurred level is sequentially increased can be generated. 

FIG. 13 shows principles of a method for presenting multistep depth of field. 
In particular, as shown in FIG. 13, in the original image, an image field in an 
area A between Znear[0] and Zfar[0] is in the just-in-focus state. 

At a first processing step, the original image is sequentially reduced at ratios of 
1/2, 1/4, and 1/8, thereafter, the reduced image is magnified, and the image significantly 
thereby blurred (blurred level: Level-2) is overwritten onto an image field in areas D 
that are located nearer to Znear[2] and farther than Zfar[2]. 
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At a second processing step, the original image is sequentially reduced at ratios 
of 1/2 and 1/4, thereafter, the reduced image is magnified, and the image thereby blurred 
at an intermediate level (blurred level: Level-1) is overwritten onto an image field in 
areas C that are located between Znear[2] and Znear[l] and between Zfar[l] and Zfar[2]. 

At a third processing step, the original image is reduced at a ratio of 1/2, 
thereafter, the reduced image is magnified, and the image slightly thereby blurred 
(blurred level: Level-1) is overwritten onto an image field in areas B that are located 
between Znear[l] and Znear[0] and between Zfar[0] and Zfar[l]. 

This way allows generation of images that present objects in states significantly 
blurred step-by-step in two directions, that is, in the depth direction and the closer 
direction from the preset just-in-focus position. 

The number of blurring steps in FIG. 13 can be optionally set corresponding to 
characteristics of images to be produced. Also, blurred levels of the individual steps can 
be optionally set according to factors such as an optical knowledge level of a producer 
(approximated characteristics of optical lenses, image angles, and other characteristics). 
In addition, lengths of the individual steps can be optionally set. 
(Shifting Just-in-focus Position) 

The just-in-focus position in FIG. 13 can be set to a point of a desired depth from 
the viewpoint, that is, a desired Z value. Also, as in FIG. 13, the depth direction and the 
opposite depth direction (nearer direction) may be blurred symmetrically or non- 
symmetrically, or in a single direction. 

By serially displaying multiple images of which the just-in-focus position is 
serially varied, images of which the depth of field serially varies can be obtained. These 
images are significantly similar to a case where a microscope is used to observe test 
pieces, thereby focal points thereof are serially shifted so as to match portions in the 
depth direction of the test pieces. 
[Flowcharts] 
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FIG. 14 is a flowchart of generating a still image of an object in a state where the 
image is displayed significantly bluned sequentially in two directions->the depth 
direction and the nearer direction— from a preset just-in-focus position. 

In the flowchart, FL represents a depth of filtering processing (Note, however, 
5 that FL > 0.). The depth of filtering processing also represents the number of filters in 
the area ranging from the just-in-focus position (Zfar[0] to Znear[0]), shown in Fig. 13, 
to one of the farther direction and the nearer direction, that is, the depth level of the out- 
of-focus state. 

Zfar[0,...,FL-l] represents positions of filters to be applied farther than the just- 
10 in-focus position, and Zfar[FL-l] represents that the filter indicated therein is located 
farther than Zfar[0]. Similarly, Znear[0,...,FL-l] represents the position of the filter 
indicated therein to be applied nearer than Znear[0]. Also, an area sandwiched between 
Znear[0] and Zfar[0] is not blurred as the area is in the just-in-focus state (just-in-focus 
area). 

15 As example definitions, FL = 1 in the single-step depth-of-field display; and the 

least number of steps in the multistep depth-of-field display is two, in which case FL = 
2. These example definitions arc used here so as make the explanation to be concise. 

Step SlOO determines whether or not FL representing the depth of the fiitering 
processing is positive. If FL is positive, processing proceeds to the next step. If FL is 
20 not positive, processing terminates. For example, since FL = 1 in the single-step depth- 
of-field display, and FL = 2 in the simplest-step depth-of-field display, processing 
proceeds to step S200 in the two cases. 

Step S200 assumes FL, which represents the depth of filtering processing, as -1. 
For example, FL = 0 is set in the single-step depth-of-field display, whereas FL = 1 is 
25 set in the multistep depth-of-field display. 

Step S300 assumes FL as the level. Therefore, for example, Level = 0 is 
assumed in the single-step depth-of-field display, whereas Level = 1 is assumed in the 
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double-step depth-of-field display. 

Step S400 executes processing PROCl. After executing PROCl, processing 
control returns to step SIOO. For example, since the single-step depth-of-field display is 
assumed as FL = 0, processing terminates. Also, in the case of the double-step depth-of- 
5 field display, since it is assumed as FL = 1, step S200 assumes it as FL = 0, step S300 
assumes it as Level = 1, and step S400 reexecutes the processing PROCl with these 
values. After the reexecution of the processing PROCl, processing returns to step SIOO, 
then terminates. 

FIG. 15 is a flowchart of processing PROCl of step S400 shown in FIG. 14. The 
10 flowchart covers one run of filtering processing steps, making a loop for executing steps 
until a counter value M exceeds tfie level (a value in Level). 
Step S410 resets the counter value M to zero. 

Step S420 compares the count value M to the level. If the counter value M is the 
same as or smaller than the level, processing proceeds to step S430. If the counter value 
15 M is greater than the level, processing proceeds to step S422 in FIG. 16. For example, 
in the single-step depth-of-field display, since Level = 0 and the counter value M = 0, 
processing executes one round of the loop, then proceeds to processing in FIG. 16. 
However, in the double-step depth-of-field display, since Level = 1, processing proceeds 
to step S430. 

20 Step S430 determines whether or not the counter value is zero. If the coimter 

value M is zero, processing proceeds to step S440, If the counter value M is not zero, 
processing proceeds to step S450. In this way, the first run of processing proceeds to 
step S440, and thereafter, processing proceeds to step S450. 

Step S440 reduces the VRAM rendering area vertically and horizontally at a 

25 ratio of 1/2 and sends the resultant image to a work area M (which is assumed to be a 
work area-0 in this particular case). The above is performed because the image is stored 
in the VRAM rendering area in the first run. For example, in the single-step depth-of- 
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field display, processing proceeds to step S440, whereby reducing tlie VRAM rendering 
area vertically and horizontally at a ratio of 1/2, then sends the resultant image to the 
work area-0. 

Step S450 reduces a work area M-1 vertically and horizontally at a ratio of 1/2 
5 and sends the resultant image to the work area M. For example, processing proceeds to 
step S440 in the first run of the loop in the double-step depth-of-field display, then 
proceeds to step S450 in the second run of the loop. Step 450 reduces the 1/2-reduced 
image stored in work area-0 vertically and horizontally at a ratio of 1/2, then sends the 
1/4-reduced image to a work area-l. 
10 Step S460 increments the counter value M by one, then processing control 

returns to step S420. 

FIG. 16 is a flowchart of image-overwriting processing. The processing shown 
therein first uses the described Z value and blurs an object located farther than a point 
represented by a preset Z value. Subsequently, the processing uses the alpha bits (mask 
15 bits) and blurs an object located nearer than the point represented by the preset Z value. 

Step S422 magnifies the work area M-1 (which contains a finally reduced image) 
back to the original image size and outputs the resultant image so that an image field 
located farther than a point represented by Zfar[FL] in the VRAM rendering area is 
overwritten. For example, in the single-step depth-of-field display, since FL = 0 and M 
20 = 1, step S422 magnifies the work area-0 to the original image size to slightly blur the 
image (blurred image of 1/2 resolution) so that an image field located farther than a 
point represented by Zfar[0] in the rendering area is overwritten and blurred. 

In the second run of the loop in the double-step depth-of-field display, since FL = 
1 and M = 2, the work area-l is magnified to the original image size so as to blur the 
25 image more significantly (blurred image of 1/4 resolution) so that an image field located 
farther than a point represented by Zfar[l] is overwritten and blurred. 

Step S424 always (unconditionally) clears mask bits in the entire VRAM 
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rendering area. This is preliminary processing to be performed for the mask bits. 

Step S426 paints out alpha planes in the VRAM rendering area so that all the 
mask bits of pixels located farther than a point represented by Znear[FL] turn on. For 
example, in the single-step depth-of-field display, since PL = 0 and M = 1, pixels 
located farther than point represented by Znear[0] in the VRAM rendering area are 
masked so as not to be overwritten. In the second run of the loop in the double-step 
depth-of-field display, since PL = 1 and M = 2, pixels located farther than a point 
represented by Znear[l] in the VRAM rendering area are masked, thereby preventing 
the overwritten area from spreading wider. 

Step S428 magnifies the work area M-1 to an image in the original size and 
outputs the resultant image so tfiat only pixels of which mask bits are not turned on in 
the VRAM rendering area are overwritten. Thus, the area not masked is overwritten, 
and a blurred image of an object located nearer is overwritten thereon. Thereafter, 
processing control returns to step S420. 

As described above, the processing in flowcharts shown in FIGS. 14 to 16 allows 
generation of a still image in which the image field near the point represented by the 
preset Z value is displayed in the just-in-focus state. On the other hand, in the still 
image, the image field located nearer than the point represented by the preset Z value is 
blurred sequentially corresponding to the distance from the viewpoint, and the image 
field located farther than the point represented by the preset Z value is also blurred 
sequentially corresponding to the distance from the viewpoint. 

Generating a number of the images of which the Z value is varied depending on 
the image reduced step-by-step and displaying the multiple images in series on a display 
(monitor) allows display of images in which the just-in-focus state serially varies. This 
allows the provision of realistic simulation effects. 
[Applicability to an Actual Data-Processing Program] 

The described depth-of-field display method can be applied to an actual data- 
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processing program, for example, in various ways described below. 

(1) This depth-of-field display method can be executed with information- 
processing systems, such as entertainment systems or the like, including personal 
computers, image-processing computers, and TV game apparatuses, which have a Z- 
buffer and bilinear filters. 

The above embodiment has been described with reference to processing of the 
method in the VRAM area, but a CPU of a computer can also perform the processing. 
When using the CPU to implement the method, since processing related to the Z value 
cannot be optionally determined, there is no restriction such as that, as described above, 
the Zrbuffer functions only in the single direction. Therefore, the CPU does not require 
the masks (alpha planes) used in the embodiment to blur an image field located nearer 
than a point represented by a preset Z value. 

(2) At present, the display method serially varying the depth of field in real time 
can be implemented by use of a combined VRAM as a rendering apparatus. In 
presently available personal computers, speeds for data transfer between a main 
memory and a VRAM are too low to implement the method of the present invention. 
Present techniques are still behind in development of buses for performing high-speed 
transferring of one-image data (for example, data of R, G, and B in 640 x 480 dots) 
between graphics circuits. 

Also in entertainment systems such as TV game apparatuses, although VRAM 
rendering area can be reduced without problems, the systems in which texture areas are 
physically spaced from the VRAM are not suitable to implementation of the method 
according to the present invention. 

In the present technical level, the described display method serially varying the 
depth of field can be implemented only with a system that has a VRAM in a circuit of 
graphic processing unit (GPU) and a texture area, a rendering area, and a work area in 
the VRAM (that is, these areas are available in the same memory space). This system is 
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capable of implementing the described display method because the GPU is capable of 
performing high-speed processing of the display method serially varying the depth of 
field. 

The depth-of-field display method of the present invention should become able 
to be implemented not only with the system using the combined VRAM but also with 
other regular processors when required high-speed data transfer be realized in the course 
of progress in the related technical field. Therefore, it should be understood that the 
present invention could be implemented not only with the system using the combined 
VRAM but also with other processors such as personal computers. 

(3) The depth-of-field display method will be supplied to, for example, software 
manufacturers as a library with software tools. This case enables creation of software 
that provides game screens showing the depth of field simply by defining parameters, 
such as Z values, FL values, level values, and Z-value variations. 

According to the present invention, a rendering apparatus capable of showing the 
depth of field can be provided. 

Furthermore, the present invention can provide a method for showing the depth 
of field that gives a sense of distance from the viewpoint to objects. 

Still furthermore, present invention can provide a storage medium for storing a 
data-processing program for displaying the depth of field that giving the sense of 
distance from the viewpoint to objects on two-dimensional screens. 

As above, the present invention has been described with reference to what is 
presently considered to be the preferred embodiment. However, it is to be understood 
that the invention is not limited to the described embodiment and modifications. On the 
contrary, the invention is intended to cover various other modifications and equivalent 
arrangements included within the spirit and scope of the invention. 
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CLAIMS 

1. A rendering apparatus comprising a device for generating an image in an out-of- 
focus state by using an original image in a just-in-focus state, reducing the original 

5 image^ and thereafter, magnifying the reduced image. 

2. A rendering apparatus comprising a Z-buffer for setting the depth direction of 
pixels and a pixel-interpolation algorithm, further comprising: 

a device for presetting a Z value of said Z-buffer; 
10 a device for generating an image in a out-of-focus state by reducing an original 

image in a just-in-focus state, and thereafter, magnifying the reduced image; and 

a device for overwriting said image in the out-of-focus state on said original 
image by using said preset Z value; 

wherein said rendering apparatus turns an image field of an object corresponding 
15 to the point represented by said Z value to the just-in-focus state, and concurrently, turns 
an image field of an object other than said object to the out-of-focus state, thereby 
showing depth of field. 

3. A rendering apparatus as claimed in claim 2, wherein said device, which 
20 generates the image in the out-of-focus state by reducing said original image and then 

magnifying the reduced image, sequentially reduces said original image and, thereafter, 
magnifies the reduced images, thereby generating the images in out-of-focus states. 

4. A rendering apparatus as claimed in claim 2, wherein said pixel-interpolation 
25 algorithm is a bilinear filter method. 



5. 



A rendering apparatus as claimed in claim 2, further comprising alpha planes for 
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selectively masking the pixels; wherein said rendering ^paratus uses said preset Z 
value to sequentially reduce said original image, to overwrite out-of-focus and blurred 
images obtained by magnifying the reduced images on said original image, and to turn 
image fields of objects located farther than a point represented by said Z value; and said 
5 rendering apparatus uses said alpha planes to mask the image fields of the objects 
located farther than the point represented by said Z value, thereafter, to overwrite said 
out-of-focus and blurred images on said original image, and to turn image fields located 
nearer than the point represented by said Z value to out-of-focus states. 

10 6. A rendering apparatus as claimed in claim 2, further comprising a video RAM 
(VRAM) having a rendering area and a texture area in the same memory space, wherein 
said rendering apparatus sequentially reduces said original image in said VRAM, and 
thereafter, magnifies the reduced images, thereby generating said out-of-focus and 
blurred images. 



7. A rendering apparatus comprising a Z-buffer for setting the depth direction of 
pixels and a pixel-interpolation algorithm, further comprising: 
a device for presetting a Z value of said Z-buffer; 

a device for generating multiple out-of-focus images each having a unique out- 
20 of-focus level by reducing an original image in a just-in-focus state to images each 
having a unique linear ratio, and thereafter, magnifying images thereby reduced; and 

a device for using said preset Z value to overwrite said out-of-focus image on the 
original image in the just-in-focus state, of which said out-of-focus level is increased 
corresponding to an increase in its distance from a point represented by said Z value, on 
25 the original image; 

wherein said rendering apparatus turns an image field of an object located at a 
point corresponding to said Z value to the just-in-focus state, and concurrently, turns an 



15 
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image field of an object other than said object to the out-of-focus state wherein said out- 
of-focus level is increased corresponding to an increase in its positional distance from 
the point represented by said Z value, thereby generating images showing depth of field. 

5 8. An image-generating method comprising steps for preparing an original image in 
a just-in-focus state, reducing said original image, and magnifying the reduced image, 
thereby generating an image in an out-of-focus state. 

9. An image-generating method comprising steps for preparing an original image in 
10 a just-in-focus state, sequentially reducing said original image, and magnifying the 

reduced images, thereby generating images in out-of-focus states. 

10. An image-generating method comprising steps for preparing an original image in 
a just-in-focus state, sequentially reducing said original image to images each having a 

15 unique linear ratio, and individually magnifying the reduced images each having the 
unique linear ratio, thereby generating a plurality of out-of-focus images each having a 
unique blurred level. 

11. A depth-of-field display method comprising steps for using a pixel-interpolation 
20 algorithm to reduce an original image, and thereafter, to magnify the reduced image, 

thereby generating a blurred and out-of-focus image; and for using a Z-buffer capable of 
controlling the distance in the depth direction from a viewpoint, thereby overwriting 
said out-of-focus image on said original image. 

25 12. A depth-of-field display method as claimed in claim 11, wherein said steps, 
which generates said out-of-focus image by reducing said original image and 
magnifying the reduced image, generates said out-of-focus image by sequentially 



• 
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reducing said original image, and thereafter, magnifying the reduced images. 

13. A depth-of-field display method as claimed in claim 11, wherein said out-of- 
focus image is overwritten on an image field of an object located farther than a point 

5 represented by a preset Z value according to said steps for overwriting said out-of-focus 
image on said original image. 

14. A depth-of-field display method as claimed in claim 11, wherein said pixel- 
interpolation algorithm is a bilinear filter method. 

10 

15. A depth-of-field display method as claimed in claim 11, wherein said depth-of- 
field display method is executed in a video RAM (VRAM) having a rendering area and 
a texture area in the same memory space. 

15 16. A depth-of-field display method comprising steps for using a pixel-interpolation 
algorithm to sequentially reduce an original image, and thereafter, to magnify the 
reduced images, thereby generating out-of-focus images; and for using alpha planes 
having a masking function to mask image fields of objects located farther than a f)oint 
represented by a preset Z value and to overwrite said out-of-focus images on said 

20 original image that has been masked, thereby turning image fields that have not been 
masked to out-of-focus states. 

17, A depth-of-field display method as claimed in claim 16, wherein said pixel- 
interpolation algorithm is a bilinear filter method. 

25 

18. A depth-of-field display method as claimed in claim 16, wherein said depth-of- 
field display method is executed in a video RAM (VRAM) having a rendering area and 



# 
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a texture area in the same memory space. 

19. A depth-of-field display method as claimed in daim 16, comprising steps for 
using a pixel-interpolation algorithm to sequentially reduce an original image, and 
5 thereafter, to magnify the reduced images, thereby generating images in out-of-focus 
states; for using a Z-buffer capable of controlling the distance in the depth direction 
from a viewpoint to overwrite said images in the out-of-focus states on said original 
image, thereby tuming image fields of objects farther than the point represented by a 
preset Z value to out-of-focus states; and for using alpha planes having a masking 
10 function to mask the image fields of the objects located farther than the point 
represented by said preset Z value and to overwrite said images in the out-of-focus 
states on said original image, thereby tuming image fields that have not been masked to 
out-of-focus states. 

15 20. A depth-of-field display method as claimed in claim 16, wherein said pixel- 
interpolation algorithm is a bilinear filter method. 

21. A depth-of-field display method comprising steps for tuming image of objects 
located at a position corresponding to a preset Z value to a just-in-focus state and 

20 overwriting images of which levels of out-of-focus states are sequentially increased 
corresponding to an increase in their positional distances to one of a farther direction 
and a nearer direction from a point represented by said preset Z value; for using a pixel- 
interpolation algorithm to perform sequential reductions of an original image, and 
thereafter, to perform magnification of the reduced images, thereby generating said 

25 images in the out-of-focus states; and for controlling levels of said out-of-focus states 
according levels of said sequential reductions. 
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22. A depth-of-field display method as claimed in claim 21, wherein said preset Z 
value serially varies per image. 

23. A storage medium for storing an image-generating program so as to be readable 
5 and executable by a computer, wherein said image-generating program comprises steps 

for preparing an original image in a just-in-focus state, reducing said original image, 
and magnifying the reduced images, thereby generating images in out-of-focus states. 

24. A storage medium for storing an image-generating program so as to be readable 
10 and executable by a computer, wherein said image-generating program comprises steps 

for preparing an original image in a just-in-focus state, sequentially reducing said 
original image to images each having a unique linear ratio, and individually magnifying 
the reduced images each having a unique linear ratio, thereby generating a plurality of 
out-of-focus images each having a unique blurred level. 

15 

25. A storage medium for storing an image-generating program so as to be readable 
and executable by a computer, wherein said image-generating program comprises steps 
for using a pixel-interpolation algorithm to sequentially reduce an original image, and 
thereafter, to magnify the reduced images, thereby generating images in out-of-focus 

20 states; for using a Z-buffer capable of controlling the distance in the depth direction 
from a viewpoint to overwrite said out-of-focus images on said original image, thereby 
turning image fields of objects farther than a point represented by a preset Z value to 
out-of-focus states; and for using alpha planes having a masking function to mask the 
image fields of the objects located farther than the point represented by said preset Z 

25 value and to overwrite said images in the out-of-focus states on said original image, 
thereby turning image fields that have not been masked to out-of-focus states. 
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26. A storage medium for storing an image-generating program so as to be readable 
and executable by a computer, wherein said image-generating program comprises steps 
for using a pixel-interpolation algorithm to reduce an original image, and thereafter, to 
magnify the reduced image, thereby generating a blurred and out-of-focus image; and 

5 for using a Z-buffer capable of controlling the distance in the depth direction from a 
viewpoint, thereby overwriting said out-of-focus image on said original image. 

27. A storage medium as claimed in claim 26, wherein said steps, which generates 
said out-of-focus image by reducing said original image and magnifying the reduced 

10 image, generates said out-of-focus image by sequentially reducing said original image, 
and thereafter, magnifies the reduced images. 

28. A storage medium as claimed in claim 26, said out-of-focus image is overwritten 
on an image field of an object located farther than a point represented by a preset Z 

15 value according to said steps for overwriting said out-of-focus image on said original 
image. 

29. A storage medium as claimed in claim 26, wherein said pixel-interpolation 
algorithm is a bilinear filter method. 

20 

30. A storage medium for storing an image-generating program so as to be readable 
and executable by a computer, wherein said image-generating program comprises steps 
for using a pixel-interpolation algorithm to sequentially reduce an original image, and 
thereafter, to magnify the reduced images, thereby generating out-of-focus images; and 

25 for using alpha planes having a masking function to mask image fields of objects 
located farther than a point represented by a preset Z value and to overwrite said out-of- 
focus images on said original image that has been masked, thereby turning image fields 
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that have not been masked to out-of-focus states. 



3L A storage medium as claimed in claim 30, wherein said pixel-interpolation 
algorithm is a bilinear filter method. 

5 

32. A storage medium for storing an image-generating program so as to be readable 
and executable by a computer, wherein said image-generating program comprises steps 
for using a pixel -interpolation algorithm to sequentially reduce an original image, and 
thereafter, to magnify the reduced images, thereby generating out-of- focus images; for 

10 using a Z-buffer capable of controlling the distance in the depth direction from a 
viewpoint to overwrite said out-of-focus images on said original image, thereby turning 
image fields of objects farther than a point represented by a preset Z value to out-of- 
focus states; and for using alpha planes having a masking function to mask image fields 
of objects located farther than the point represented by said preset Z value and to 

15 overwrite said out-of-focus images on said original image, thereby turning image fields 
that have not been masked to out-of-focus states. 

33. A storage medium as claimed in claim 32, wherein said pixel-interpolation 
algorithm is a bilinear filter method. 

20 

34. A storage medium for storing an image-generating program so as to be readable 
and executable by a computer, wherein said image-generating program comprises steps 
for turning image of objects located at a position corresponding to a preset Z value to a 
just-in-focus state and overwriting images of which levels of out-of-focus states are 

25 sequentially increased corresponding to an increase in their positional distances to one 
of a farther direction and a nearer direction from a point represented by said preset Z 
value; for using a pixel-interpolation algorithm to perform sequential reductions of an 
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original image, and thereafter, to perform magnification of the reduced images, thereby 
generating said images in the out-of-focus states; and for cxmtroUing levels of said out- 
of-focus states according levels of said sequential reductions. 



5 



35. A storage medium as claimed in claim 34, wherein said preset Z value serially 
varies per image. 
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